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ABSTRACT 

The purpose of this paper is to describe current 
practices in various states used to identify linguistically different 
students, provide a review of literature regarding recommended 
practices, and offer alternative practices for identifying 
linguistically different students. The paper provides an information 
base regarding current identification practices; suggests a way to 
systematically identify limited English proficient student using 
multiple criteria; and offers a paradigm that will allow the U.S. 
Department of Education and the various state departments of 
education to collect consistent data regarding the students in need 
of English language assistance. Two responses to the paper, one by 
Julia Lara, the other by Robert Rueda, are provided. (VWL) 
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The development of the paper was rather like deja vu. Since 
1974, when I entered the public school system as a recent graduate 
of a Speech Pathology program, I had all the answers...until I started 
working with children in a Chapter 1 identified campus in a border 
town school district. Each year, teachers would refer entire classes 
to me, and I realized quickly that I did not have the slightest idea 
how to tell the difference between those in need of Speech Pathology 
services and those in need of English language development services. 

Two decades later, we still wrestle with the same issues, and I 
submit to you that, given the background of the students now enter- 
ing the public school system, more and more students will be in need 
of English language development/Speech Pathology services related 
to articulation and language disorders, regardless of their ethnic or 
linguistic background. 

Thus, the purpose of this paper is to describe current practices in 
various states used to identify linguistically different students, pro- 
vide a review of the literature regarding recommended practices, and 
offer alternative practices for identifying linguistically different stu- 
dents. The expectation is that the information contained herein can 
serve multi-fold purposes: 



1. 



provide an information base regarding current identification 
practices 



2. suggest a way to systematically identify limited English profi- 
cient students using multiple criteria; and 

3. offer a paradigm that will allow the United States Department of 
Education and the various state departments of education to col- 
lect consistent data regarding the students in need of English 
language assistance. 

Methodology 

To this end, in addition to a review of the literature, surveys 
were mailed to 17 states that provided a geographical representation 
of the eastern, heartland, and western regions as well as a multilin- 
gual and multicultural representation of the 17 states surveyed, 9 
responded. These states graciously responded within a two-week 
time frame which is most deeply appreciated and acknowledged. 
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The recommendations in the section entitled "Paradigm for De- 
termining English Language Assessment Needs" seeks to incorporate 
yet expand current practices extant in the various states. The intent 
is to make the modification of traditional practices more palatable 
and pragmatic which will enable practitioners to move toward the 
use of multiple criteria for identification and assessment of linguisti- 
cally different students. 

Review of Language Assessment Practices 
in Selected States 

The purpose of the survey was to obtain data on the LEP popula- 
tion and the English speaking population by grade level with respect 
to ethnicity, language(s) spoken, and program offerings and to exam- 
ine these data for any relational patterns between the size and the 
type of the LEP population versus the identification and assessment 
practices in the various states. 

The limited information received as a result of the survey pre- 
cluded making any generalizable observations. An attempt to utilize 
data provided by another national study (Olsen, 1991) yielded some 
discrepancies between data provided in the report and data provided 
by some of the states surveyed. Thus, efforts to address the intent of 
the survey were not very successful. 

Sufficient information was provided, however, regarding the 
identification and assessment practices utilized to make the following 
observations: 

Home Language Surveys (HLS) are used by each of the respond- 
ing states as the initial screening instrument although the number of 
items on the HLS varied from state to state. Also, some states, such 
as New Mexico, use ethnicity as the identification criteria on the 
HLS and others use languages spoken. Variations in these instru- 
ments generate different kinds of information that can be collected 
regarding LEP populations. One additional factor that may be prob- 
lematic in using this self-report type of instrument stems from misin- 
formed parents or guardians who feel a need to misrepresent the na- 
tive language spoken in the home. Such parents often feel that their 
children will be placed in programs that are not conducive to learn- 
ing English if they respond truthfully on the HLS. 

Standardized Achievement Tests (SATs) are used by every state, 
however, the cutoff score for identification, and exit criteria, varies 
between the 23rd percentile and the 40th percentile. This large dis- 
crepancy between cutoff scores will significantly impact on the num- 
ber of LEP students identified per state. 
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Oral Language Proficiency Tests (OLPTs) are also used by every 
state although some states, such as New Mexico, limit their recom- 
mendations to four specifically listed OLPTs and others, such as 
Texas, list eight possible options. Inter- and intra-state variations in 
the OLPTs utilized also contribute to inconsistent identification and 
data collection practices because there is no correlation between the 
various instruments. 

Some of the states suggest the use of optional criteria and merely 
list the possibilities, e.g., interviews, observations, and classroom 
performance, while other states (Louisiana, New Mexico) suggest 
specific interview techniques or checklists for specific performance 
behaviors. Regardless of the optional criteria used, the difficulty lies 
in that there is no apparent means of correlating performance on 
these alternative measures with their performance on the SATs or 
the OLPTs. 

Additionally, many states allow each school district total au- 
tonomy regarding procedures utilized. This factor, coupled with the 
wide variation in practices, has implications for collecting consistent 
data regarding the number of LEP students, the kinds of languages 
spoken, and the level of assistance needed. Further, it makes it ex- 
tremely difficult to conduct statewide or nationwide research on pro- 
grams serving LEP students that will yield consistent, credible, and 
defensible data for decision makers in the field. 

Recommended Integrative Approaches to 
Language Assessment 

In reviewing the states' practices for identifying LEP students, 
two criteria surfaced repeatedly as being used extensively, although 
the manner in which these criteria were used varied. These two cri- 
teria are the standardized achievement tests and the oral language 
proficiency tests. Much has been written about the inadequacies of 
standardized achievement tests and oral language proficiency tests 
as measures of an individual's proficiency in English (Canales, 1990; 
TEA, 1988; Oiler, 1973). Regardless of their shortcomings, to date, 
they have been widely used by the majority of the states as a basis 
for consistent measurement of students' linguistic performance. 
Since the 1970s, however, several options have been recommended 
that would provide practitioners with a more realistic and compre- 
hensive assessment of an individual's English language proficiency 
(Canales, 1990; Erickson, 1981; Thonis, 1980; Oiler, 1973). Some 
states reported using these measures, or at least recommending 
them as optional measures in their state publications. 

These optional measures assess language proficiency while a stu- 
dent is engaged in a meaningful speech event. This is known as an 
integrative approach to language assessment because students utilize 

c i 
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several communication skills simultaneously. The use of these rec- 
ommended measures to assess an individual's integrative use of lan- 
guage skills is necessary because, heretofore, primary measures of 
language assessment, namely SATs and OLPTs, have focused on dis- 
creet items of language proficiency, e.g, use of verb tense, use of cor- 
rect vocabulary term. This process severely limits the amount of in- 
formation regarding an individual's actual proficiency with a lan- 
guage because language usage: 

1. is dynamic and contextually based (varies depending upon the 
situation, the speakers, and the topic) 

2. is discursive (requires connected speech) 

3. requires the use of integrative skills to achieve communicative 
competence. 

This definition of language usage is predicated on a socio-linguis- 
tic theoretical base suggesting that language is more than just a sum 
of its discrete parts. The implication then is that language assess- 
ment instruments also need to follow a similar theoretical base, a 
practice that has historically been ignored in traditional language 
assessment procedures (Canales, 1990). 

Language assessment instruments consistent with this philoso- 
phy are known as measures of integrative skills and include observa- 
tion instruments (rating scales and checklists), interviews, dictation 
tests, and cloze instruments. A de^ "ption of each follows. 

Observation Instruments 

Classroom observations of students interacting in various set- 
tings are the basis for determining students' linguistic proficiency. A 
student's linguistic performance in listening and speaking is rated 
on a five-point scale of proficiency, ranging from non-native speaker 
of English to proficient speaker of English, for each of the four lin- 
guistic subsystems - graphophonemic (letters/sounds), lexicon (vo- 
cabulary), morphology (grammar), and semantics (syntax/meaning) 
(see Appendix A & B). These rating scales are completed by the 
classroom teacher after observing students in various classroom set- 
tings. Separate rating scales can also be completed for observations 
of casual, social interactions, such as playground or cafeteria talk. 
Appropriate completion of these rating scales requires that the class- 
room teacher have an understanding of the criteria used to rate each 
of the linguistic subsystems. 

The behaviors on the rating scale can also be listed in a checklist 
format in increasing order of difficulty for ease in scoring and analy- 
sis. 
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Interviews 



Structured interviews are developed and administered on an in- 
dividual basis. Ideally, an examiner should conduct the interview 
while a language specialist transcribes the examinee's responses, 
noting the use of the four linguistic subsystems. The advantages of 
this kind of measure are that it can be individually tailored to the 
experiences of the examinee and it allows the examiner opportunities 
to explore an individual's knowledge of the language. 

The disadvantages, however, are several. First, it usually re- 
quires two people to administer the interview, a skilled interviewer 
and a language specialist. Second, this interview scenario has the 
potential to distract the examinee and perhaps contribute to dimin- 
ished responses because of intimidation, especially for young chil- 
dren. Third, individualized administration makes it a time-consum- 
ing procedure. Finally, without appropriate scaling criteria, inter- 
views are unsuitable for widespread use in schools as a tool for iden- 
tification and placement of students. 

Dictation Tests 

The examinee listens to text dictated from graded material and 
writes down what is heard. The premise for this measure of integra- 
tive skills is that the individual needs to have knowledge of the four 
linguistic subsystems in order to convert speech to print. The use of 
dictation tests is advantageous because they: 

• are easily developed from material used in everyday classroom 
situations such as basal readers, science books, or social studies 
books; 

• can be administered in a group setting; and 

• do not require extensive specialized training to develop or admin- 
ister. 

The few disadvantages of dictation tests, which can occur in the 
administration phase and the scoring phase, are manageable if the 
examiner is aware of them. First, an examiner's dialectal differences 
may cause difficulties in transcribing speech to print, a problem that 
could be overcome by using a taped version of the dictation. A re- 
lated problem, students' lack of familiarity with this type of test, can 
be mitigated with practice sessions prior to the actual dictation to be 
used as the measure of language proficiency. 

Second, an examinee's unfamiliarity with all of the variations in 
spelling of English sounds may cause interference for the examinee 



in converting speech to print, for example, writing "miss is esmith" 
for "Mrs, Smith," for example. This difficulty can be overcome by 
having the dictation tests scored by someone who knows the differ- 
ences between the graphic and phonetic systems of the examinee's 
native language compared to the system in English. 

Third, the dictation test requires that the individual being tested 
knows how to write and finally, appropriate criteria for scaling need 
to be developed as in the case of the interviews. 

Cloze Instruments 

The examinee is asked to complete a readability-graded passage 
from which words have been omitted at regular intervals (usually 
every fifth word). The premise of this procedure is that language is 
highly redundant, with many contextual clues that can inform the 
examinee of the appropriate missing words if that person has a com- 
mand of the language being tested. Cloze instruments have been 
used for many years and validated by reading specialists. Adminis- 
tered and analyzed properly, the results of cloze tests will yield infor- 
mation regarding the examinee's level of facility with the text. Such 
information is useful in planning for students' instructional needs. 

In addition to its instructional orientation, there are many ad- 
vantages to this procedure. The test can be prepared easily using 
texts that students use in the classroom, thus making the assess- 
ment procedure a functional one. Further, the test can be adminis- 
tered in a group setting and quickly scored. If administered to native 
English speakers at the same grade level, their scores can serve as a 
basis of comparison for the non-native speakers' scores. Additionally, 
the construction, administration, and scoring of the cloze test do not 
require any extensive specialized training to use correctly. 

The difficulty in implementing the use of integrative measures of 
English language proficiency lies in the lack of 

• broad based acceptance with respect to their ease of development 
and administration, 

• understanding of the breadth and depth of their usefulness, and 

• standardized procedures for consistently collecting and correlat- 
ing alternative data on students. 

These factors preclude the use of 'integrative measure' data in 
making uniform decisions regarding the identification, placement, 
and exit needs of LEP students. 
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Following is a model for ameliorating this dilemma. The scope of 
the model, however, exceeds the traditional practice of identification 
and can be used to make decisions for placement and exit, as well. 
Use of this model consolidates the gathering of information for prac- 
titioners and enables them to make informed decisions regarding the 
needs of the linguistically different children. 

Paradigm for Determining English 
Language Assistance Needs 

The model mentioned above is a comprehensive process that 
identifies not only students in need of language assistance but the 
level of assistance needed as well. The process involves a systematic 
documentation of students' linguistic proficiency in formal and infor- 
mal settings and academic and non-academic settings. In short, this 
process generates a profile of a student's needs for language assis- 
tance and thus, has been titled the English Language Assistance 
Needs (ELAN) Profile Chart. The ELAN Profile Chart enables prac- 
titioners to document data needed to appropriately meet the instruc- 
tional needs of students and the programmatic needs of campuses. 

There are specific steps that must be addressed prior to imple- 
menting the effective use of such a model. These steps include 

• identifying criteria to be used, 

• developing a Likert rating scale to accompany each criterion, 

• determining the range of scores possible for each category of 
need, and 

• designing and implementing the training necessary to institu- 
tionalize the process. 

Specifically, each step entails the following considerations. 

Criteria Development 

A comprehensive assessment of a student's language assistance 
need(s) requires that data be gathered in three areas. These three 
sets of data include non-academic related oral language proficiency 
data, social data, and academic data (OSA). In each of these areas 
local/state education agencies have the flexibility to include as many 
options as are feasible to be undertaken. The important consider- 
ation is that each option be clearly delineated and available to all of 
the individuals involved to ensure consistency of implementation. 
Some of the examples of the types of options have been mentioned in 
the section entitled "Review of Language Assessment Practices in Se 
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lected States" and discussed in the section entitled "Recommended 
Integrative Approaches to Language Assessment." These options, 
and others, are listed below along with a brief rationale for their uti- 
lization. 

Oral Language Proficiency Data 

Home Language Survey — This serves as an initial screening and 
is currently used in many states. It can provide useful information 
regarding baseline data such as language(s) spoken in the home. 

Oral Language Proficiency Test ~ These prepackaged instru- 
ments provide inexperienced practitioners with baseline data regard- 
ing students' linguistic performance albeit minimal data. 

Oral Language Interview Instruments — These instruments en- 
able interviewers to probe for information not readily accessible 
through pen and paper tests. 

Observation Instruments -- Provide detailed, comprehensive data 
on students as they engage in actual speech events which minimize 
the intimidation factor present in other testing situations. 

Social Data 

Socio-Economic Status (SES) — An often disregarded criterion, 
the SES of a student can offer valuable information regarding the 
amount of oral/aural stimulation received in the home. Typically, 
children from low to mid SES home environments are not likely to 
have 

• engaged in much dialogue, 

• been read to by their parents, 

• or experienced summer camps, organized sports, or other similar 
experiences that help develop linguistic skills. 

Schooling Experience -- This, too, is an often disregarded crite- 
rion. Information gained can inform practitioners about the possible 
level of skills learned in a formal school setting. If these skills are 
not continuously developed or are developed in a country other than 
that of the target community, students will need additional interven- 
tion services. 

Observation Data - This information obtained from the home 
and other social settings such as the playground, the cafeteria, etcet- 
era can validate, or confirm, other data gathered. 




Academic Data 



Achievement Test - Standardized achievement tests have been a 
primary source of data used by many states. As mentioned previ- 
ously, however, the cut off score for eligibility has varied from state 
to state. Many states also use state-specific standardized tests. Un- 
less these instruments are administered at each grade level, such in- 
struments will not provide consistent data and, thus are not recom- 
mended for use as criteria. 

Cloze Test -- Used by many states, such instruments provide use- 
ful data regarding the students' language proficiency level with 
classroom text information that is the basis for participation and pro- 
motion in the schooling process. Its ease of administration and scor- 
ing make it a valuable criterion for consideration. 

Six Weeks Grades - This criterion provides formative data on 
students' performance and is the primary criterion used for promo- 
tion. The mean should be monitored during each six weeks across 
subject areas and the mean for the first five of the six v/eeks should 
be used as one of the criteria for assessing English language assis- 
tance needs. Individual school agencies need to establish specific 
subject areas to include in the mean. 

Observation Data Checklists or rating scales utilizing specific 
performance criteria can provide information regarding students' use 
of language in contextual situations. 

While the number of criteria suggested above may seem unrea- 
sonable, multiple data are necessary to develop a consistent and de- 
fensible process for documenting the identification, placement, and 
progress of LEP students and the benefit of effective programs 
needed to serve thent. 

Likert Rating Scale Development 

The second necessary step in the process is the development of a 
rating scale for each criterion to be included in the ELAN Profile 
Chart (see Appendix O). A five-point scale is recommended to pro- 
vide consistency across sites using a similar procedure. Following 
are examples of suggested scales as well as brief rationales/explana- 
tions for the descriptors accompanying each rating. 
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Home Language Survey 



1 - Only Native Language Spoken 

2 ~ Mostly Native Language Spoken 

3 ~ Native and English Languages Spoken 

4 — Mostly English Spoken 

5 - Only English Spoken 

Most of the home language surveys presently used by state or 
local education agencies ask three to eight questions that would yield 
this information. Examples of some of the questions include, 

• Which language did your child first learn to speak? 

• What language does your child use most often at home? 

• What language do you most often use to speak to your child? 

• What language does the father speak to his child most of the 
time? 

• What language does the child speak to his/her father most of 
the time? 

• What language does the mother speak to her child most of 
the time? 

• What language does the child speak to his/her mother most of 
the time? 

• What language does your child speak to his/her brothers and 
sisters most of the time? 

• What language does your child speak to his/her friends most 
of the time? 

Oral Language Proficiency Instrument 

1 - Non-English Speaker 

2 — Extremely Limited English Proficiency 

3 -- Limited English Proficiency 

4 — Near Native-Like English Proficiency 

5 ~ Fluent English, Native-Like Proficiency 

The descriptors for this scale reflect those found in OLPTs 
adopted for state use. Each descriptor has a range of possible scores 
based on the students' performance on the test. 

Oral Language Interview Instrument 

1 - 80-100 percent Native Language Responses 

2 - 50- 79 percent Native Language Responses 

3 - < 50 percent in either Language 

4 - 50- 79 percent English Language Responses 

5 — 80-100 percent English Language Responses 



This scale can be applied to any interview instrument regardless 
of the number of items contained therein. While specific response 
criteria is not provided, the expectation is that the interviewer will 
have been appropriately trained to score acceptable responses. 

Observation Data 

1 - Pre-Production Stage 

2 - Early Production Stage 

3 - Speech Emergence Stage 

4 - Intermediate Stage 

5 - Fluent Stage 

These are widely used labels for the various stages of language 
development (references). Specific behaviors relevant to each of the 
stages can be found in Appendix C. 

Socio-Economic Status 

1 -- < $5,000 

2 -- $5,000 - 10,000 

3 - 10,000 - 25,000 

4 - 25,000 - 35,000 

5 «- 35,000 - 45,000 

These ranges are partially aroitrarily based on the qualifications 
for free and reduced lunch as well as a general approximation of the 
relative cost of meeting the basic needs of a family versus the 
affordability of "frills." 

[Note: Perhaps a more precise scale can be determined using the 
current Poverty Level Index that considers the number of family 
members versus the income.] 

Schooling Experience 

1 - No Previous Schooling or All English Program Only 

2 - Intern pted Schooling/Some ESL Instruction 

3 - Schooling in Other Countries 

4 - ESL program only since entering U.S. school system 

5 Bilingual education program only since entering U.S. school sys- 
tem 

This factor is critical to successful participation in the academic 
setting. Students with little or no previous formal schooling experi- 
ences or students placed in inappropriate programs will be in need of 
extensive linguistic and cultural education services. 
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Observation Data (Home, with friends) 

1 - Uses native language ONLY in all settings 

2 — Relies on native language in all settings 

3 — Uses the native language sparingly in all settings 

4 - Uses the English language with friends only 

5 - Uses the English language mostly in all settings 

Knowledge of language use in various settings can also indi- 
cate the possible level of proficiency with respect to vocabulary devel- 
opment. 

Standardized Achievement Data 

1 - < 20 %ile 

2 - 20-29 %ile 

3 - 30-40 %ile 

4 - 41-59 %ile 

5 - 60-80 %ile 

The distribution of percentile points for each rating decreases 
from 20 to 9 because of the critical need to have a command of the 
language in order to perform well on these tests, recognizing of 
course that knowledge of the English language is not the only critical 
factor central to performing well on these measures. It should be 
noted that the ratings of 1 and 2 exceed the maximum cut-off scores 
found in states with large populations of linguistically different stu- 
dents, however, this type of scale can provide consistency in identifi- 
cation data and is thus presented as such. 

Cloze Test 

1 - Raw Score of 0 - 20 

2- Raw Score of 21 -30 

3- Raw Score of31-40 

4 Raw Score of 41 - 49 

5 - Raw Score of 50 

Cloze measures can be statewide versions based on state adopted 
texts or local versions. Decisions will need to be made regarding 
which content areas to include as cloze texts. 

Six Weeks Grades 

1 - <= 59 

2 - 60's 

3-70's 1 n 

4 - 80's X O 

5 90's 
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The six weeks grades for each of the content areas can be used as 
a formative measure to monitor additional needs for English lan- 
guage assistance. The mean of the six weeks grades for the first five 
six weeks, either for individual subject areas or across subject areas, 
is recommended to assist decision makers in the early identification 
of students in need of English language assistance for the subse- 
quent school year. Subject areas to be considered for determining 
this mean should at least include Language Arts, Science, and Social 
Studies given the language demands of the disciplines. 

Observation Data by Grade Level and Subject Area 

1 - Points, identifies 

2 -- Names, lists 

3 - Describes, tells (simply) 

4 - Compares, describes (more complex) 

5 - Analyzes, synthesizes 

Linguistic information obtained as students engage in academic 
work can be particularly insightful for making programmatic deci- 
sions for these students. This information can be obtained using 
checklists or rating instruments once the desired behaviors have 
been identified (see Appendices D-L). 

The ratings for each criterion presented above can easily be re- 
corded in sample charts provided in the Appendix section of this pa- 
per. Appendix M illustrates an Individual English Language Assis- 
tance Needs Profile Chart and Appendix N illustrates a Campus 
Language Assistance Needs Profile Chart for use in recording the 
pertinent data. 

In some instances, decisions will need to be made regarding miss- 
ing data or non-applicable data. Suggested for use are "M" for data 
that is Missing and "0" for data that is not applicable, so that it will 
not get factored into the total count. Comments about why the de- 
scriptors were not applicable would be helpful in informing future 
users of the data and alerting them to changes which may need to be 
made. This procedure will ensure consistency in and utility of data 
collected. 

Distribution of Scores by Category of Need 

Once the criteria and the ratings have been determined, the next 
step involves the distribution of the number of points possible into 
each of the categories of needs « Beginning, Intermediate, Advanced. 
Given the descriptors attached to each rating, the greater the num- 
ber of points accumulated per child, the greater the child's profi- 
ciency in the English language. In contrast, the fewer the number of 
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points accumulated for each child, the greater the demand for En- 
glish language assistance. This inverse relationship between points 
accumulated versus need is consistent with current practices in the 
various states. Such that, if students are at a "Level 3," they are at 
the advanced, near proficiency stage, and if they are at a "Level 1," 
their proficiency in English is virtually non-existent. 

To further illustrate this point, if 11 criteria are selected to in- 
clude in the ELAN Profile Chart as suggested above, then the great- 
est number of points would equal 55 [5 (rating) x 11 (criteria)] and 
the least number of points possible would equal 11 [1 (rating) x 11 
(criteria)]. An individual student can total less than 11 points if 
there are some data that are Not Applicable (see Note below). An ex- 
ample, of the distribution of points is provided below. 

34 - 55 Advanced Stage (Total possible if student scores all 5s or 
some 5s & 4s) 

23 - 33 Intermediate Stage (Total possible if student scores all 3s 

or some 3s and 2s) 
00 - 22 Beginning Stage (Total possible if student scores all 2s or 

Is) 



[NOTE: A score of 0-10 might be possible if there were missing 
data. If the criterion was important enough to include, decision 
makers may want to monitor the student's performance until the 
necessary additional information is available.] 

As with every process conceptualized for wide use, certain reali- 
ties, such as lack of resources, often preclude the comprehensive and 
extensive use of recommended procedures. In those instances, the 
following alternative is offered: 



1. Deduct five points per criterion omitted from the overall total 
and adjust the totals in the three categorical levels accordingly. 



55 Total in example (11 criteria) 

- 5 Oral language interview 

- 5 Observation Data (Social) 
45 New Total for 9 criteria 



28 - 45 Advanced (Scored all 5s or some 5s & 4s) 

19 - 27 Intermediate (Scored all 3s or some 3s and 2s) 

00 - 18 Beginning (Scored all 2s or Is, and possibly some 0s) 



2. Add five points for each criterion included to the overall total and 
adjust the three categorical levels accordingly. 



55 ~ Total in example (11 criteria) 
+ 5 - State-wide test administered at each grade level 
60 - New Total for 12 criteria _ 

102 ± 0 



37 - 60 Advanced (Scored all 5s or some 5s, 4s, & 3s) 

25 - 36 Intermediate (Scored all 3s or some 3s and 2s) 

00 - 24 Beginning (Scored all 2s or Is, and possibly some 0s) 

If the school records of students are unavailable due to high mo- 
bility factors or recent immigrant status, then certain criteria may be 
selected in order to identify language assistance needs upon the 
student's arrival. For example, the Home Language Survey, the 
Oral Language Proficiency Test, the Previous Schooling, and the 
Oral Interview data can all be obtained readily. The distribution of 
scores would then be adjusted accordingly so that decisions regard- 
ing need and placement could be made. This would ensure that the 
student received appropriate services pending the arrival or attain- 
ment of additional information such as SAT scores or grades. 

Advantages of the ELAN Profile Chart 

Although at first glance, the process may seem cumbersome, the 
ELAN Profile Chart has many potential advantages. Some of these 
advantages include: 

Teacher judgment is systematically documented. 

Comprehensive information regarding a student's language 
proficiency is uniformly documented and available for use by 
teachers or parents. 

Needs assessment can be conducted during end of the year 
LP AC meetings which, in turn, can facilitate student and faculty 
assignments for successive years. 

Consistency in the identification process is possible in that the 
categorization of English Assistance Needs levels are based on 
Likert scale totals with corresponding points of distribution re- 
gardless of the number of criterion used. 

Autonomy and flexibility in the criteria to be utilized remain 
a viable option for the state and local education agencies yet en- 
able the United States Department of Education and the state 
education agencies, respectively, to collect data on the number of 
students in need of language assistance. 

Identification, placement, and exit criteria systematically 
documented enable Language Proficiency Assessment Commit- 
tees to execute their responsibilities conscientiously, consistently, 
and equitably. 
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Paper work is reduced to a manageable level, utilizing the com- 
prehensive ELAN Individual Profile Chart (see Appendix M) or 
the ELAN Campus Profile Chart (see Appendix N). 

Future Directions 

Four critical mega-steps, if you will, need to be accomplished in 
order to implement the use of an ELAN Profile Chart. 

First, the criteria to be utilized must be determined, or devel- 
oped as in the case of the observation instruments. Second, partici- 
pants in the process will require training in the development and us- 
age of the instruments. Third, the data collected annually should be 
evaluated quantitatively and qualitatively to assess any patterns and 
note any anomalies. Fourth, longitudinal data should be cross vali- 
dated for accuracy so that adjustments in the Likert scales can be 
made accordingly. 
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Liart Rata*( Scale ftr 



Oral Uttfmf* Proficiency Data 



Academic Da** 



Home Language Survey 

I - Only Native Language Spoken 
1 - Moetiy Native Languag* Spoken 

3 - Native and Engfiah Lenguagee Spoken 

4 - Mortly Engliah Spoke q 

5 - Only English Spoken 

Orml Language Proficiency Instnanent 

1 - Nod- English Speafcif 

2 - Extremely Limited Eng liah Profkieocy 

3 - Limited English Proficiency 

4 - Near Native-Like Enf liah Proficiency 

5 - Fluent Engliah, Native-Like Prof^icocy 

Interview Instrument 

1 - 10-100% Native Languap Responses 
2-50-79* Native Language Reapooaei 
3 - < 30% in either Lingua ge 
4-50-79% English Language Rc«p° n ** 1 
5 - 10-100% English Language Rcsposwee 

Observation Data 

1 - Pre-Production Staf « 

2 - Early Production Stage 

3 - Speech Emergence Sage 

4 - Intermedial* Stage 

5 - Fluent Suge 



Standardized Achievement Dots 

1 - < 20 %ile 

2 - 20-29 %Ue 

3 - 3(M0 %ile 

4 - 41-39 %Uc 

5 -6040%ile 

One Test 

1 - Raw Score of 0 • 20 
2-Raw Score of2l-30 

3 - Raw Score of 31 - 40 

4 -Raw Score of 41 -49 
3 - Raw Score of 30 

Sir Weeks Grades 

1 - < ««59 

2 -60*a 

3 - 70*t 

4- JO'i 

5- 90't 

Observation Dot* ky Grade Level and Subject Area 

\ - Point*. idenljftca 

2 - NaoMt, lieu 

3 - Describe i. teU (simply) 

4 - Comparea, deecrihea (more complex) 

5 - Analyiae, synt he eqei 



Social DaU 

Socio-leonomic Status 

1 - < $3,000 

2 - S5.000 - 10.000 

3 - 10,000 - 25.000 

4 - 25.000 - 35.000 

5 - 35.000 - 45.000 

Schooiint Experience 

1 - No Previoua Schooling or AJI English Program Only 

2 - Interrupted Schooling/Some ESL Instruction 

3 - Schooling in Other Couixriee 

4 - ESL program only since entering U.S. school lyatem 

5 - Bilingual education program only since entering U.S. 

school ayaum 

Observation Data (Home, wim\ friends) 

1 - U»cs native languaga ONLY in ill settinga 

2 - Relies on native language tn all settings 

3 - Usee the native language sparingly in sll settings 

4 - Uaee the English language with friends only 

5 - Usee she English language snoetly in ell eeeungi 
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Response to JoAnn Canales's Presentation 



Julia Lara 
Council of Chief State School Officers, 
Washington, DC 

The comments outlined below draw extensively from the work of 
Ed De Avila, and from a report recently completed by the Council of 
Chief State School Officers (CCSSO) titled, "Recommendations for 
Improving the Assessment and Monitoring of Students with Limited 
English Proficiency". 

The author of this paper should be commended for bridging the 
gap between our knowledge of socio-linguistic theory of language 
learning and the application of the principles of this theory to the as- 
sessment of limited English proficient students. There has been for a 
number of years agreement within the field concerning the need to 
encourage the use of integrative approaches to language assessment 
(observations, interviews, dictation, etcetera. However, as noted in 
the paper, these approaches can be costly and time consuming and 
consequently districts have been reticent to use these approaches ex- 
tensively. Another key barrier preventing the use of these ap- 
proaches has been the absence of an operational definition of a lim- 
ited English proficiency student and of a fully English proficient stu- 
dent (see CCSSO document for conceptual definition of LEP and 
FEP) 1 . The methods of assessment outlined in the paper; the rating 
scales; and the social and academic data elements suggested are im- 
portant elements of a comprehensive data collection system on LEP 
students. 

However, there are a number of areas that need clarification and 
perhaps elaboration in this paper. The following comments discuss 
each of this areas of concern. 

The discussion of state assessment and data collection practices 
is limited given the limited number of survey responses obtained by 
the author. A more extensive discussion of state assessment and 
data collection practices is contained in a publication by the CCSSO 
titled, "Summary of State Practices Concerning the Assessment of 
Data Collection about Limited English Proficient Students." This re- 
port lists on a state by state basis, the pre-screening, classification, 
placement, and exiting procedures and instruments used in each 
state, and types of instrument. The report also identifies data ele- 
ments collected at the state level on LEP performance and academic 
status. 

Differentiation needs to be made between procedures used for 
classification of language proficiency status from those to be used for 
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placement. It appears that the author suggests that integrative ap- 
proaches used be used for purposes of classification along with the 
traditional oral language proficiency and achievement tests. While 
in the ideal situation this would be the best course of action to follow, 
we cannot loose sight of the realities (limitations in funding, person- 
nel) at the local level, and the importance of identifying students 
within a reasonable period of time. In states with large numbers of 
LEP students, LEAs are advised to screen, classify, and place LEP 
students in language assistance programs within 30 days of enroll- 
ment. Districts in these states must use methods that are simple, 
effective, quick, and efficient. I am not convinced that, for purposes 
of classification, local practitioners can use all three assessment 
methods suggested (oral language proficiency tests, achievement 
tests and integrative tests) within 30 days or less. In spite of the 
limitations inherent in the language proficiency tests (do not mea- 
sure all four language areas) districts may need to rely heavily on 
these instruments' use for purposes of classification 2 . However, it 
makes sense to use integrative approaches in borderline cases when 
student's score on the language proficiency tests are close to the cut- 
off point. 

For purposes of placement, monitoring language development 
and mainstreaming LEP students into the English-Only classroom, it 
is essential that the communicative based approaches outlined in the 
model be used by classroom teachers on a consistent basis. These as- 
sessments are particularly important prior to decision-making points 
along the LEP student educational continuum. A review of state 
practices shows that, for placement purposes, no state requires the 
use of observations, although 33 states do recommend that these 
methods be used. In terms of interview methods in five states they 
are required, while in 23 states they are recommended. Unless these 
procedures are required by the state, it is difficult to sort out when 
and how districts use integrative approaches. It appears that in 
many instances, LEAs opt for the least expensive option. Thus, at 
the national level, we do not have a clear picture of local practice re- 
garding use of various assessment instruments. However, we do 
know that LEAs with resources are more likely than others to use a 
variety of assessment methods for purposes of placement and exiting. 

In terms of reclassification, there is no doubt that, at the class- 
room level, teachers need to have information about what students 
can and cannot do relative to the linguistic demands of the main- 
stream classroom. Without this normative information, placement 
decisions are likely to be made in isolation of the classroom context 
and may result in premature exiting of LEP students from the lan- 
guage support programs. Integrative methods are certainly the most 
valid mechanisms for providing information to teachers about stu- 
dent linguistic performance. 
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More needs to be said about issues of reliability. Some concerns 
have been raised about the extent to which rating scales can be ap- 
plied systematically across various contexts. Ed DeAvila has noted 
in his writings that teacher rating is problematic because they are 
highly dependent on the teacher's language background, the 
teacher's familiarity with the child, and the teacher's knowledge of 
language development (Ed DeAvila, 1990). I am not certain that 
these concerns have been addressed by the model. Assessment ex- 
perts may need to look more closely at this issue relative to the rec- 
ommendations outlined in this paper. 

The use of socio economic data for purposes of identification and 
placement can be misused. The author asserts that this information 
can be used as an indicator of "oral/aural stimulation received in the 
home" and subsequently suggests family income as the measure of 
SES. The relationship between lack of stimulation in the home and 
development of linguistic skills in the LEP students' first of second 
language needs further exploration. There is no direct relationship 
between poverty status and inability to learn a second language as 
there is between poverty and academic achievement (broadly de- 
fined). To imply that there might be a positive relationship between 
the two is to minimize the role of both the developing linguistic and 
literacy skills of LEP students independent of socio economic back- 
ground. The author needs to strengthen the case for the use of SES 
as an important element of the profile and show how it bears on lan- 
guage learning. 

In terms of data collection, the data elements contained in the 
ELAN profile will be useful in terms of classroom level instructional 
needs. However, for decision making at the state and local level, the 
data set needs to be more comprehensive. Administrators and deci- 
sion makers need information that can be used for program evalua- 
tion/development purposes such as referrals to special education, 
placement in categorical programs, dropout rates, attendance, reten- 
tion in grade and much more. 

Finally, while this paper identified the key assessment methods 
essential for student identification, it did not outline how these vari- 
ous assessment methods would relate to each other and at what 
point in the educational experiences of the LEP student. Nonethe- 
less, the ELAN Profile chart is a promising mechanism for decision 
making at the local level. With additional development it should be 
very useful to practitioners and to officials in state education agen- 
cies. 
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Notes 



1 The CCSSO publication cited above, "Recommendations for 
Improving.. ..Limited English Proficiency," contains a definition for 
a limited English proficient student and for a fully English profi- 
cient student. 

2 Along with the information obtained in the screening devise, 
Home Language Survey. 
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Response to Jo Ann Canales 9 Presentation 

Robert Rueda 
University of Southern California 

The paper by Dr. JoAnn Canales on innovative practices in the 
identification of LEP students set out to accomplish three distinct 
goals. One was to provide information on current identification prac- 
tices by state departments of education, including measures which 
they suggest or propose. A second goal was to present a way to sys- 
tematically identify LEP students through the use of multiple alter- 
native criteria. Finally, the last goal was to outline a paradigm that 
would permit state departments to collect consistent data for stu- 
dents in need of English language assistance. In preparing my com- 
ments, I have followed the order of the main points made in the pa- 
per, and therefore I will present those comments in that sequence. 
At the end of the commentary, I will present a set of suggestions for 
possible future drafts of the paper. 

Current Practices 

In order to provide data on current practices around the country, 
Dr. Canales conducted a survey in which seventeen states were con- 
tacted. Responses were received from eight of these states. Al- 
though there were practical constraints on collecting this data due to 
limited time, certain details were omitted from this early draft of the 
paper which would have been desirable from a methodological per- 
spective. For example, it is not entirely clear exactly what the state 
department representatives were asked in terms of survey items. In 
addition, information about sampling would have been useful as well. 
For example, how were these seventeen states selected? In examin- 
ing the states that responded, some of the states with significant 
numbers of language minority students were absent, including 
Florida, California, and Arizona. Since states vary significantly re- 
garding proportions of language minority students, they are not all 
weighted equally in terms of importance, and it would be interesting 
to have additional data on what other states are doing. These limita- 
tions in terms of sampling need to be taken into account in interpret- 
ing the generalizability of the survey results. 

Notwithstanding these potential limitations regarding 
generalizability, there appear to be two major findings which 
emerged from the survey. First, there is wide variation in terms of 
current state practices. This is not altogether surprising, however, it 
does suggest that aggregating data and arriving at a summary state- 
ment regarding national practices is not a simple or direct matter. 
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The second finding is that, if the measures the states are using 
are examined, in addition to the Home Language Survey which is 
used by almost all, there is a strong reliance on standardized tests 
and oral language proficiency tests. In attempting to evaluate this 
pattern, it is useful to ask what is currently known about language 
in terms of research and theory and then compare that with current 
practices. 

Although the body of research on language and bilingualism is 
immense and complex, there are some generalizations which would 
likely result in wide agreement. For example, work in linguistics, 
anthropology, cross-cultural psychology, cognitive psychology, and 
other fields suggest that language use (and by extension, "profi- 
ciency") is context-sensitive and context-specific. Proficiency is no 
longer viewed as a fixed, invariant, "within-the-head" phenomenon. 
Secondly, language is inherently social. It is acquired and used in 
social settings for social purposes. Thirdly, language is acquired, not 
learned. That is, it is rare to see a parent saying to a child, "Today 
we are going to learn plurals" in the normal course of the day's ac- 
tivities. It is acquired in natural settings in the course of people's 
needs to accomplish specific social activities such as eating, dressing, 
and so forth. 

Another thing which is known about language is that it is used 
in order to accomplish meaningful activities. That is, it is purpose- 
ful, a tool in order to accomplish everyday tasks. It is also a tool in 
the sense of being a sign system, which is used to mediate cognition. 
In this sense, there is an intriguing link between language and 
thought as Piaget, Vygotsky, and many others have noted. A final 
point about language is that it can be seen as an integrated part of a 
larger system of literacy. Therefore, if language is broadened to in- 
clude written language and so forth, then perhaps the focus on oral 
language is overly narrow. 

If the above generalizations about language are taken as a sim- 
plified summary of current views, and compared to the reported 
practices of state departments of education, there is not a great deal 
of correspondence or match. Specifically, the heavy reliance on stan- 
dardized tests, achievement tests, and oral language proficiency mea- 
sures as reported in the survey suggest that an outdated view of lan- 
guage is being used to drive practice. 

Comments on an Alternative Model: 
The ELAN Profile Chart 

Taking the same general points about language as a starting 
point, the author's proposed model can be compared tr the generali- 
zations described above as well. In the paper, Dr. Canales discussed 

128 b ^ 



the theoretical base of the model as being sociolinguistic. As de- 
scribed in the paper, it is fairly consistent with the generalizations of 
language outlined earlier, certainly much closer than reported school 
practices. 

The proposed model suggests that data be collected in three ar- 
eas: oral language proficiency, social data, and academic data. The 
use of multiple evaluative criteria is suggested, and it is proposed 
that the scores can then be converted to Likert-scale ratings. From 
these converted ratings, a profile can be constructed and a classifica- 
tion derived, resulting in a designation of either advanced, interme- 
diate, or beginning level. 

Although the proposed model is certainly more comprehensive 
than what is currently being carried in many school districts, there 
are some components which might merit consideration for inclusion. 
One, for example, would be data on the affective state of the child 
with respect to first and second languages and their usage. As my 
colleague at USC, Steve Krashen suggests, the affective state of the 
child is important in terms of how rapid and effective the second lan- 
guage acquisition process is, and is an additional but important piece 
of data. 

Another important piece of data of great interest would be the 
socio-political context in which the first and second languages are 
being or have been acquired. The relative status of LI and L2 has an 
important impact on the child's acquisition of language, yet it is nor- 
mally ignored in the assessment process because the focus is exclu- 
sively on the child. 

A major component of the ELAN Profile Chart is the Likert-scale 
score conversions, which in essence is a data-reduction technique. 
That is, data from various types of proposed measures are converted 
to a five-point scale, making the data more comparable. However, 
when data is reduced by this or any other technique, precision is lost. 
As an example, a percentile score of 83.5 on a standardized measure, 
when converted to its transformed equivalent on a five point scale in 
order to make it more comparable to other data, loses some precision. 
This may be useful in aggregating and summarizing data across dis- 
tricts and/or states, however data is converted to an ordinal scale of 
measurement. That is, it is possible to say that a four is less than a 
five, but not how much more, and the distance between a three and a 
four, for example, may not be equivalent to the distance between a 
four and a five. 

Another consideration in the proposed model is that equal 
weights are given to each of the proposed indicators, if my under- 
standing is correct. Assuming that it is, this would suggest that the 
data from the Home Language Survey would be equivalent in impor- 
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tance to protracted observational data in a large number of contexts. 
Is it logical to equate the meaningfulness or usefulness of these 
distinctly different sources of data? I would suggest that this point is 
certainly open to question. 

One of the curious aspects of the proposed ELAN Profile Chart is 
that many of the alternative measures proposed were already listed 
as options by many state departments of education. An important 
question, it seems, is why are states not using these measures al- 
ready? These alternatives to standardized tests already exist and 
are available, suggesting that perhaps the development of completely 
new measures may not be what is needed in the assessment of LEP 
students. The alternatives which do exist are not extensively used, 
and I wall return to this point shortly. 

One point of contention with the proposed ELAN model would be 
the almost exclusive focus on oral language, more specifically En- 
glish oral language. It seems this is overly restrictive in light of how 
language and literacy are currently viewed. From my perspective, it 
would be desirable to consider relative linguistic proficiency, not only 
in English but in the child's native language as well. Secondly, I 
would suggest broadening the scope to a wider focus on literacy as 
opposed to oral language exclusively. This might mean more atten- 
tion to written language and other forms of literacy which are tradi- 
tionally separated for assessment and instructional purposes. How- 
ever, given the strong relationships among these, and the current 
view of language and literacy as part of a complex whole, separating 
out oral language from other parts of the child's development may 
not be the most advisable course. 

A final point with respect to the ELAN model has to do with the 
distinction between classification and diagnosis. The former is the 
term for sorting and comparing students. That is, who is lower? Who 
is higher? Who goes into this group? Who goes into that group? The 
latter term, in contrast, refers to data used to derive intervention or 
treatment. The conceptual distinction between these two terms is 
often confused in discussions or assessment procedures. My under- 
standing of the ELAN model suggests that it is concerned with the 
issue of classification. Certainly Likert-scale conversions will allow 
one to say who is higher and who is lower on one or more measures. 
However, data of this type are not terribly useful for day-to-day in- 
structional decisions. Data of the type provided by converted stan- 
dardized scores are severely limited. If the concern is "What does 
this child know and what is the next thing this child needs to work 
on?" For the practitioner needing to know, "What do I do with this 
particular child today?" Global comparative data does not provide a 
very specific answer. Simply put, I would like to argue for increased 
attention to instructional relevance and data more accessible to in- 
structional personnel. 
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Considerations for Future Revisions 



Obstacles to change. In this final section, I would like to provide 
some suggestions for consideration in future revisions to the paper 
presented. One critical question has to do with the obstacles to 
change in educational institutions. A great deal of attention is cur- 
rently being given in assessment circles to alternatives to traditional 
standardized assessment, which many have described as problemat- 
ic. Why is it, however, that even when alternatives are available 
they are not heavily used? I would like to propose two hypotheses 
which might merit consideration as alternative assessment models 
are developed and considered. 

One hypothesis is that teachers, bilingual specialists, and other 
practitioners in school settings have a particular schema or mental 
model of assessment. That is, this mental model provides a unified, 
logical framework of thinking about what assessment is, why it is 
used, how it fits together with instruction, and so forth. One possi- 
bility is that the mental model of assessment embedded in schools is 
very different from that embedded in the work of those researchers 
and theoreticians concerned with developing alternative assessment 
models. However, these underlying assumptions and belief systems 
are rarely taken into account. Innovative practices which do not 
neatly fit into one's existing mental model are ignored or discarded. 
Simply put, it is not enough to develop and disseminate alternative 
assessment models or procedures without taking into account the ex- 
isting belief structures of the "end users." When viewed in this per- 
spective, the failure of school practitioners to incorporate new assess- 
ment developments is logical and understandable. Unfortunately, 
rather than examining test-users, research (mostly guided by a psy- 
chometric framework), has tended to concentrate on the technical 
characteristics or procedural aspects of the tests themselves with 
little attention to those who would use them. It is important to rec- 
ognize that many of the new innovations in assessment methodology 
and theory are rooted in a different paradigmatic framework from 
that familiar to many practitioners. 

A second hypothesis is based on Mehan's work on educational de- 
cision making in special education. In his ethnographic examination 
of the referral, assessment, and placement process, he found that de- 
cisions were rarely made on the basis of rational consideration of test 
data and other child-related characteristics, as is assumed to take 
place in current law. Rather, he found the process to be charac- 
terized by "social negotiation/' trade-offs, and bargaining; A child's 
educational fate often depended upon these interpersonal negotia- 
tions among educational personnel. In trying to make sense of these 
findings, Mehan assumed that all the actors were not malicious or 
incompetent. Rather, he concluded that their behavior was rational 
given the "institutional constraints" under which they were forced to 
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operate: limited time, budgetary shortages, conflicting laws, and so 
forth. The conclusion was that these very powerful everyday con- 
straints had an overwhelming impact on day-to-day behavior, and 
what appeared irrational on the surface actually made sense. By ex- 
tension, it can be assumed that there are such constraints in institu- 
tional settings such as state departments of education, school dis- 
tricts, and individual classrooms which mitigate against change. 
These have yet to be studied, although it is possible that they exert 
significant pressure on the implementation of new assessment proce- 
dures. 

The Larger Context of Assessment 

One point that I would like to see addressed in this paper is in- 
creased consideration of recent developments regarding assessment 
at the national level. As an example, there is much talk about more 
authentic assessment to reflect closer alignment to authentic curricu- 
lum (c.f., the California Language Arts Framework) and to recent 
theories of cognition and learning. Portfolios and other innovations 
are being widely discussed, even as pressure is mounting for national 
indicators of performance. It is likely that the next few years may 
usher in significant change in how assessment is conceptualized and 
used because of events taking place at the national level. The work 
discussed in this present paper under consideration should not be 
treated in isolation from these developments, but rather should be 
considered within that larger context. 

The issue of entry and exit . One factor which might merit fur- 
ther attention in future work on this topic is the whole issue of entry 
to and exit from bilingual programs. At present, it appears that 
schools operate from a rather inflexible, all-or-none system that is 
heavily reliant on standardized assessments. It would be useful to 
consider more flexibility within this system, especially since learning 
is not conceptualized in such an all-or-none fashion. How could al- 
ternative assessment for LEP students be restructured to assist in 
this process? 

The issue of eligibility . Because of my background in special edu- 
cation, I have a special sensitivity to the whole issue of eligibility. 
This has been a central concern of the field, and I would like to hope 
that in the treatment of language minority students we learn from 
the mistakes which have been made. Historically, much attention 
has been placed on the question, Who has learning problems, and 
who does not? Who should receive services and who should be ex- 
cluded? Tremendous amounts of scarce resources are spent on gen- 
erating psychological reports and making complicated eligibility de- 
terminations. Entry into the system in most cases is dependent upon 
meeting a certain profile or criteria. In spite of the fact that the as- 



sessment methodology and procedures are often technically inad- 
equate, the field has focused on making finer and finer distinctions 
between groups of students at a tremendous cost. However, much of 
the assessment data collected during this sorting process does not 
readily translate into educational prescriptions. Moreover, many 
have argued that there are not really separate treatments for all the 
various diagnostic categories once they are filled. 

The field of special education is currently in the midst of wide- 
spread controversy precisely because of these factors. It would be my 
hope that, in the field of bilingual education, we could avoid and even 
learn from some of these same mistakes. In order to meet these chal- 
lenges, truly innovative developments are required at the level of as- 
sessment. However, it is not sufficient to consider the procedural as- 
pects of new assessment methodologies apart from the new para- 
digms in which they are embedded or apart from the social contexts 
in which they will be used, that is, individual classrooms. 
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